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- The MAILING DATE of this communication appears on the cover sheet with the correspondence address 
Period for Reply 

A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) FROM 
THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1 .1 36(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from Ihe mailing date of this communication. 

- If the period for reply specified above is less than thirty (30) days, a reply within the statutory minimum of thirty (30) days will be considered timely . 

- If NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this communication. 

- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 133). 

- Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent term adjustment. See 37 CFR 1.704(b). 

Status 

1)13 Responsive to communications) filed on 07 April 2000 . 
2a)D This action is FINAL. 2b)H This action is non-final. 

3) D Since this application is in condition for allowance except for formal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quayle, 1935 CD. 1 1 , 453 O.G. 213. 
Disposition of Claims 

4) [x] Claim(s) 1-38 is/are pending in the application. 

4a) Of the above claim(s) is/are withdrawn from consideration. 

5) D Claim(s) is/are allowed. 

6) |3 Claim(s) 1-38 is/are rejected. 

7) D Claim(s) is/are objected to. 

8) D Claim(s) are subject to restriction and/or election requirement. 

Application Papers 

9) E3 The specification is objected to by the Examiner. 

10) Q The drawing(s) filed on is/are: a)D accepted or b)Q objected to by the Examiner. 

Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1.85(a). 

11) D The proposed drawing correction filed on is: a)Q approved b)D disapproved by the Examiner. 

If approved, corrected drawings are required in reply to this Office action. 

12) D The oath or declaration is objected to by the Examiner. 
Priority under 35 U.S.C. §§119 and 120 

13) D Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 119(a)-(d) or (f). 

a)D All b)D Some*c)D None of: 

1 .□ Certified copies of the priority documents have been received. 

2. Q Certified copies of the priority documents have been received in Application No. . 

3. Q Copies of the certified copies of the priority documents have been received in this National Stage 

application from the International Bureau (PCT Rule 17.2(a)). 
* See the attached detailed Office action for a list of the certified copies not received. 

14) D Acknowledgment is made of a claim for domestic priority under 35 U.S.C. § 119(e) (to a provisional application). 

a) □ The translation of the foreign language provisional application has been received. 

1 5) Q Acknowledgment is made of a claim for domestic priority under 35 U.S.C. §§ 1 20 and/or 121. 

Attachment(s) 

1 ) S Notice of References Cited (PTO-892) 4) □ Interview Summary (PTO-41 3) Paper No(s). . 

2) |3 Notice of Drafts person's Patent Drawing Review (PTO-948) 5) □ Notice of Informal Patent Application (PTO-152) 

3) S Information Disclosure Statement(s) (PTO-1449) Paper No(s) 3. 6) □ Other: 

U.S. Patent and Trademark Office — / , 

PTO-326 (Rev. 04-01) p/2Lf°i Office Action Summary Part of Paper No. 4 
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Detailed Action 

1. Drawings have been objected to by the Draftsperson under 37 CFR 1.84 or 1.152, correction 
noted on PTO-948 is required. A proposed drawing correction or corrected drawings are required in reply 
to this office action to avoid abandonment of the application. The objection to the drawings is no longer 
held in abeyance. If reply does not include corrected drawings, proposed corrections, or reply to the 
drawings requirement, the reply would be held non-responsive (See MPEP §1.85 revised, 65 FR 54604, 
Sept. 8, 2000, effective Nov. 7, 2000; Para, (a) revised, 65 FR 57024, Sept. 20, 2000, effective Nov. 29, 
2000). 

Specification 

2. It is noted that this application appears to make reference to subject matter disclosed in co- 
pending or related application(s), e.g. pages 15, 21, and other pages. A reference to the related 
application must be inserted as the first sentence of the specification of this application or in ah 
application data sheet (37 CFR 1.76) (removing informal data such as docket numbers, etc.), if applicant 
intends to rely on the filing date of the prior application under 35 U.S.C. 119(e) or 120. See 37 CFR 
1.78(a). For benefit claims under 35 U.S.C. 120, the reference must include the relationship (i.e., 
continuation, divisional, or continuation-in-part) of all nonprovisional applications, see 37 CFR 
1.78(a)(2)(ii) and (a)(5)(ii). Also, current status of the above application need to be proved, e.g. pending, 
abandoned or patent with corresponding patent numbers. 

3. It is note that applicant's disclosure contains embedded hyperlinks and other forms of browse- 
executable code have been noted in the specification of instant application. Noted hyperlinks and/or other 
forms of browser-executable codes will be treated as part of applicant's invention and are necessary to be 
included in the patent application in order to comply with the requirements of 35 U.S.C. 112, first 
paragraph, and applicant does not intent to have these hyperlinks be active links. 

Claim Rejections - 35 USC § 103 

4. The following is a quotation of 35 U.S.C. § 103(a) which forms the basis for all obviousness 

rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in section 
102 of this title, if the differences between the subject matter sought to be patented and the prior art are such that the 
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subject matter as a whole would have been obvious at the time the invention was made to a person having ordinary skill 
in the art to which said subject matter pertains. Patentability shall not be negatived by the manner in which the 
invention was made. 

5. Claims 1-38 are rejected under 35 U.S.C. 103(a) as being unpatentable over SAYLOR et. al. 
(Saylor) U.S. Patent No. 6,501,832 in view of HUNA U.S. Patent No. 6,438,217. 

Regarding claim 1, Saylor teaches substantial features of the invention as claimed, teaching a 
system/method including a computing device (12 of Fig. 1) (portal) comprising: 

an interface (conversational browser) for conducting information exchange (i.e. multi-modal 
dialog) (col 23/lines 34-47, col 4/lines 43-col 5/line 20) with clients (14 of Fig. 1, col 14/lines 10-14) 
having varying input/output I/O (i.e. visual or audio) capabilities (i.e. I/O modalities) (col 9/lines 67-col 
10/line 5), 

wherein the conversational browser retrieves information (content: col 2/lines 5-16, visual or 
audio content, & multi-modal information col 4/lines 16-28) from an information source (70 of Fig. 1, col 
11/lines 43-52 or 18 of Fig. 1, col 14/lines 19-28, or 22 of Fig. 1) in response to a request (col 8/lines 37- 
63) from a requesting client (col 5/lines 9-20, col 8/lines 37-53, retrieval module: col 3 1/lines 1-15), 

serving or presenting the retrieved information to the requesting client (col 3/line 63 -col 4/line 4) 
format that is compatible with the I/O modalities of the requesting client (col 8/lines 14-36, presented to 
the user: col 5/lines 4-8, provide to user visual or audio content: col 5/lines 9-20). 

although the above-mentioned prior of record teaches a device for conducting the claimed multi- 
modal dialog as discussed above, this device is not called a "conversational browser" and the I/O 
capabilities (i.e. modalities) of the prior art do not include only one modality (e.g. voice-only); 

Huna teaches s system/method related to information exchange (i.e. dialog) (col 1/lines 50-53) 
with user at endpoint devices (102, 108 & 110) having varying I/O capabilities (col 6/lines 24-28, e.g. 
voice-only, text-only, col 20/lines 52-55, 66-col 21/line 2), teachings means for serving or presenting 
information to the user in a format that is compatible with the I/O modality (Fig, 8), including identifying 
the I/O modality of the device to whom communication is to be delivered (col 1 9/lines 29-41) and based 
on determining the I/O modality of said device (Fig. 8, step 816), converting the information to be 
delivered to identified device based on is I/O capabilities or modalities (Fig. 8, step 818, col 1 5/lines 25- 
45, conversion capabilities based on the I/O capabilities of the receiving device, col 20/lines 34-35); 

It would have been obvious to one ordinary skilled in the relevant art at the time the invention 
was made to utilize Huna's teachings for identifying the I/O modalities of a device and presenting/serving 
information in a format that is compatible with the I/O modalities of the client to whom information is to 
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be delivered, i.e. presented or served, motivation would be integrate multiple modalities (i.e. access 
modes) from multiple distinct devices operating in telephony and data networks supporting 
communicated between said different without requiring special purpose hardware/software modification 
to the client device. 

Regarding claims 2-3, the information provided by the information sources is implemented in a 
multi-modal representation, which is a format (modality-independent format) (Saylor: col 14/lines 46-60, 
multi-modal content col 23/lines 34-47, col 4/lines 43-col 5/line 20). 

Regarding claim 4, computing device (transcoder), operatively associated with the conversational 
browser, for converting the (multi-modal) information into one specific format (modality-specific format) 
based on the I/O modalities of the requesting client (Saylor: col 23/lines 60-67, col 21/lines 7-41). 

Regarding claim 5, the conversational portal discovers, ascertain, identify (i.e. detects) the 1/0 modalities 
of the requesting client to convert the multi-modal information into the modality-specific format (Saylor: 
col 21/lines 7-41, modality of client: col 18/lines 45-col 19/line 11, col 19/lines 46-50, conversion: col 
23/lines 60-67). 

Regarding claim 6, discern (i.e. detects) the 1/0 modalities of the requesting client based on the 
registration protocols (Saylor: registration setup: transactions based on user identified registration, col 
8/lines 56-col 8/line 13, subscribe registration discern modalities of client, col 16/lines 18-col 17/line 4). 

Regarding claim 7, comprising a (portal directory) database (Saylor: 18 of Fig. 1, col 14/lines 19-28), 
accessible by the conversational browser, for storing one of an index of information sources, (Saylor: 
indexed: col 18/lines 13-19, index: col 8/lines 14-36). 

Regarding claim 8, the information is maintained in a (multi-modal) format by a service provider (Saylor: 
70 of Fig. 1, col 11/lines 43-52) of the conversational portal under business agreements between the 
service provider of the conversational portal and service provider of the information sources (Saylor: 
business arrangement: col 34/lines 14-34, business: col 38/lines 13-24). 
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Regarding claim 9, capturing a connection between the requesting client and the conversational portal and 
maintaining communication link (holding the client captive) during predetermined time periods (Saylor: 
col 26/lines 39-40). 

Regarding claim 10, a link provided by the conversational browser is selected by the requesting client and 
rendered or served to the requesting client (Saylor: voice browser; col 26/lines 41-54). 

Regarding claim 11, the requesting client is released when a link is directly requested by the requesting 
client (Saylor; col 26/lines 39-40). 

Regarding claim 12, a service provider of the conversational portal provides advertisements, during time 
period in which the requesting client is connected (Saylor: col 26/lines 39-40). 

Regarding claim 13, time period between connections established links between different information 
sources (Saylor: col 26/lines 39-40). 

Regarding claim 14, wherein the advertisements and services are multi-modal (Saylor: content: col 2/lines 
5-16, visual or audio content, & multi-modal information col 4/lines 16-28, advertisements: col 9/lines 
54-58, ads; col 36/lines 48-67). 

Regarding claim 15, wherein the advertisements and services are provided by the service provider on 
behalf of a third-party under a business agreement between the service provider of the conversational 
portal and third-party (Saylor: col 36/lines 48-col 37/line, third-party, col 45/lines 65-col 46/line 25). 

Regarding claim 16, for creating audio files or clips (segmenting) and forming structural order of the 
audio files or clips (indexing) audio and multimedia data obtained from an information source (Saylor: 
col 8/lines 14-36 audio or visual information, indexing multimedia (text, graphics, audio, video) retrieval: 
Saylor: col 8/lines 37-53); and a multimedia database for storing the indexed audio and multimedia data 
(Saylor: col 8/lines 37-53, index database; col 1 8/lines 13-19). 

Regarding claim 17, retrieving as discussed above, obtains desired segments from the multimedia 
database in response to a client request and presents such segments to the client (Saylor: col 8/lines 14-53, 
index database; col 18/lines 13-19) based on the I/O capabilities of the client (Saylor: col 3/line 63-col 
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4/line 4 format that is compatible with the I/O modalities of the requesting client col 8/lines 14-36, 
presented to the user: col 5/lines 4-8, provide to user visual or audio content: col 5/lines 9-20). 

Regarding claim 18, the conversational browser periodically downloads multimedia data from one 
information source to index and store the multimedia data in the multimedia database (Saylor: col 1 8/lines 
32-38). 

Regarding claim 19, the downloading and indexing of the multimedia data of the information source is 
performed under a business agreement between a service provider of the conversational portal and a 
service provider of the information source (Saylor: col 7/lines 4-17). 

Regarding claim 20, subscription program for registering a subscriber (col 7/lines 56-col 8/line 13), a 
program comprising user-selected multimedia segments in the multimedia database (selection of clips col 
7/lines 32-47, segments col 9/lines 47-58). 

Regarding claim 21, (registered) subscriber can conversationally navigate the program and select desired 
segments for broadcasting via the requesting client (Saylor: col 5/lines 9-20). 

Regarding claim 22, however the above-mentioned prior art of record does not teach radio services upon 

request (i.e. upon demand) which the registered subscriber access via a wireless phone. 

Official Notice (see MPEP $ 2144. 03 Reliance on "Well Known" Prior Art) is taken that radio 
services via a wireless mobile or portable phone was old and well known in the Data Processing art. It 
would have been obvious to one of ordinary skill in the art at the time of applicant's invention to include 
radio services upon request (i.e. upon demand) which the registered subscriber access via a wireless 
phone, motivation may download software to customize the wireless phone with enhancing features, such 
as mobile service authorization codes that are specific to the wireless mobile radiotelephone set owner 
and operative for enabling telephone service to the wireless mobile radiotelephone set (see Ref A). 

Regarding claim 23, comprising features discussed on claim 1, same rationale of rejection is applicable 
and further: 

an access device having one input/output modality (Saylor: device supporting one modality: col 
9/lines 59-col 10/line 5, client access device: col 5/lines 9-20 supporting one modality, user device: col 
14/lines 10-14, Huna: devices (102, 108 & 110) having varying I/O capabilities (col 6/lines 24-28, e.g. 
voice-only, text-only, col 20/lines 52-55, 66-col 21/line 2); 



Application/Control Number: 09/545,078 (MAES) 
Art Unit: 2142 



Page 7 



a content server (70 of Fig. 1, col 11/lines 43-52 or 18 of Fig. 1, col 14/lines 19-28). 

Regarding claim 24, the content server provides one of multi-modal content Vpages (pages) (Saylor: 
visual/audio mode page content, col 2/lines 4-17, multi-mode content, col 4/lines 43-59). 

Regarding claim 25, wherein the multi-modal content pages and applications are implemented in a 
modality-independent representation (Saylor: col 4/lines 43-59, multi modal, col 14/lines 56-59, multi- 
modal Vpages, col 21 /lines 7-41). 

Regarding claim 26, a voice (conversational) browser for fetching and processing one multi-modal 
content page for presentation to a user based on the I/O capabilities of the access device supporting user 
selections (Saylor col 26/lines 41-45, fetch, col 29/lines 17-28, Huna: converting the information to be 
delivered to identified device based on is I/O capabilities or modalities (Fig. 8, step 818, col 15/lines 25- 
45, conversion capabilities based on the I/O capabilities of the receiving device, col 20/lines 34-35). 

Regarding claim 27, converting one multi-modal content page into one modality-specific representation 
based on detected I/O capabilities of the access device (Saylor: col 23/lines 60-67, col 21/lines 7-41, 
Huna, Fig. 8). 

Regarding claim 28, accessible by the conversational portal, for converting a modality-specific site of a 
content provider into a multi-modal representation (Saylor: the conversational portal discover, ascertain, 
identify (i.e. detects) the I/O modalities of the requesting client to convert the multi-modal information 
into the modality-specific format col 21/lines 7-41, modality of client: col 18/lines 45 -col 19/line 11, col 
19/lines 46-50, conversion: col 23/lines 60-67, Huna: converting the information to be delivered to 
identified device based on is I/O capabilities or modalities Fig. 8, step 818, col 15/lines 25-45, conversion 
capabilities based on the I/O capabilities of the receiving device, col 20/lines 34-35). 

Regarding claim 29, the conversion service is provided by the content provider (Saylor: col 2/Iines 21-26, 
59-64) or a third-party under a business agreement with the content provider (Saylor: col 7/lines 4-23). 

Regarding claim 30, an interface (conversational browser) (Saylor: interface col 5/lines 2-8) for 
processing and presenting one of a multi-modal content page and application received by the 
conversational portal (Saylor: col 10/lines 62-64). 
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Regarding claim 31, the conversational portal is access by calling a pre-designated telephone number 
(Saylor: dialing a number, col 6/lines 30-33, connect via telephone, col 25/lines 59-63. 

Regarding claim 32, a listing (directory) of content server addresses (Saylor: col 14/lines 23-32). 

Regarding claim 33, wherein the (portal directory) database comprises one of multi-modal content pages 
(Saylor: col 14/lines 23-27), associated with one content provider hosted by the conversational portal 
(Saylor: multi-modal pages associated with provider 70 of Fig. 1, col 1 1/lines 43-52) 

Regarding claim 34, comprising features discussed on claim 1 and 23, same rationale of rejection is 
applicable, and further wherein: 

access to information is over a communication network (16 of Fig. 1) (Saylor: col 14/lines 14-22); 

establishing communication with a conversational portal using an access device (14 of Fig. 1) (Saylor: 

i 

col 14/lines 1-22, access via communication link, col 5/lines 21-37, communication medium, col 1 1/lines 
43-52). 

Regarding claim 35, the retrieved information comprises one of multi-modal content pages (modality- 
independent format) (Saylor: col 14/lines 46-60, multi-modal content col 23/lines 34-47, col 4/lines 43- 
col 5/line 20). 

Regarding claim 36, detecting at least one I/O modality of the access device (Fig. 8), & (transcoding) converting 
the retrieved multi-modal information into at least one modality-specific format corresponding to the at 
least one detect I/O modality (Huna; converting the information to be delivered to identified device based 
on is I/O capabilities or modalities Fig. 8, step 818, col 1 5/lines 25-45, conversion capabilities based on 
the I/O capabilities of the receiving device, col 20/lines 34-35). 

Regarding claim 37, established communication with the user (i.e. holding the user captive) during a 
period in which the retrieving step is executed, presenting one of advertisements (Saylor: col 26/lines 39- 
40). 

Regarding claim 38, provide a broadcast on demand service (Saylor: col 26/lines 39-40). 
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6. Claim 1 may also be rejected under 35 U.S.C. 103(a) as being unpatentable over 
Jamtgaard et al. (Jamtgaard) U.S. Patent No. 6,430,624. 

Regarding claim 1, Jamtgaard teaches substantial features of the invention as claimed, teaching a 
system/method for providing multi-modal services to clients having multiple different I/O capabilities 
and/or I/O format requirement (abstract, col 1/lines 8-col 2/line 26); 

conducting information exchange (i.e. multi-modal dialog) with clients (5, 15 of Figs. 1-4) 
having varying input or output (i.e. visual and/or audio) capabilities (i.e. I/O modalities) (col 4/lines 58- 
col 5/line 6), 

retrieving information from an information source in response to a request from a requesting 
client (col 7/lines 13-15), 

serving or presenting the retrieved information to the requesting client format that is compatible 
with the I/O modalities of the requesting client (col 4/lines 39-50). 

Related U.& Patents: 

The prior art made of record and not relied upon is considered pertinent to applicant's disclosure; 
pertinence is presented in accordance with to MPEP§ 707.05. Copies of documents cited will be provided 
as set forth in MPEP§ 707.05(a): 

Ref A: U.S. Patent No. 5,297,191 (03-1994) 

Gersberg teaches a radio on demand service in which the registered subscriber access via a 
wireless phone; teaching means for remote downloading software into a wireless telephone subscriber 
set (e.g., mobile, cordless, etc.) for entering subscriber-specific programming information and wireless 
service authorization data into the subscriber's telephone set for storage therein thereby quickly, reliably 
and cost-effectively providing authorized service to a new subscriber, or to an existing subscriber who 
requests a service change (abstract), wherein the mobile service authorization codes that are specific to 
the wireless mobile radiotelephone set owner and operative for enabling telephone service to the 
wireless mobile radiotelephone set (col 6/lines 43-50) 
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Any inquiry concerning this communication or earlier communications from the examiner should 
be directed to Prieto, B. whose telephone number is (703) 305-0750. The Examiner can normally be 
reached on Monday-Friday from 6:00 to 3:30 p.m. If attempts to reach the examiner by telephone are 
unsuccessful, the Examiner's Supervisor, Mark R. Powell can be reached on (703) 305-9703. The fax 
phone number for the organization where this application or proceeding is assigned is (703) 308-6606. 
Any inquiry of a general nature or relating to the status of this application or proceeding should be 
directed to the receptionist whose telephone number is (703) 305-3800/4700. 

Any response to this action should be mailed to: 

Commissioner of Patents and Trademarks 
Washington, D.C. 20231 



Hand-delivered responses should be brought to Crystal Park II, 
2121 Crystal Drive, Arlington. VA., Fourth Floor (Receptionist), further ensuring that a receipt is 
provided stamped "TC 2100". 



or Faxed to: 



(703) 746-7239, for Official communications and entry 



Or: 



(703) 746-7240, for Non-Official or draft communications, please label 
"PROPOSED" or "DRAFT". 



Or Telephone: 



(703) 306-563 1 for TC 2100 Customer Service Office. 



B. Prieto 

GAU2142 

TC2100 




Patent Examiner 

March 27, 2003 
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